Web Survey Bibliography
Relevance & Research Question: The use of web-based data collection methods is still a growing trend in the Social Sciences. However, up to now, only very little is known about which features online researchers are actually using in their online questionnaires. The present study aims to fill this knowledge gap by examining all available active online questionnaires from five major online recruitment portals.
Methods & Data: After identifying online portal sites that are widely used by researchers to recruit participants for their online studies, we extracted objectively identifiable information regarding the use of technical features from all available online questionnaires on these portal sites (N = 720 online questionnaires). Online questionnaires were evaluated according to quality standards recommended in the methodological literature.
Results: Online questionnaires complied well with the avoidance of disadvantageous features (e.g., using pre-answered item options, using non-standard technologies), but failed to comply with standards pertaining to the implementation of advantageous features (e.g., using progress indicators, keeping expected duration short).
Added Value: Regarding the compliance with methodological standards of online questionnaires, online researchers are quite successful in avoiding the use of disadvantageous features in their questionnaires. However, online researchers should also consider the implementation of advantageous features that are beneficial for both participants' motivation and data quality.
GOR Homepage (abstract) / (presentation)
Web survey bibliography - Stieger, S. (10)
- Technical and methodological meta-information on current practices in online research: A full population...; 2013; Burger, C., Stieger, S.
- Metadata on the demographics of online research: Results from a full-range study of available online...; 2013; Burger, C., Stieger, S.
- Handle with Care: The Impact of Using Java Applets in Web-Based Studies on Dropout and Sample Composition...; 2011; Stieger, S., Goeritz, A., Voracek, M.
- What are participants doing while filling in an online questionnaire: A paradata collection tool and...; 2010; Stieger, S., Reips, U.-D.
- The influence of the field time on data quality in list-based Web surveys; 2009; Goeritz, A., Stieger, S.
- Distortion of demographics through technically induced dropout in restricted online surveys; 2009; Voracek, M., Stieger, S., Goeritz, A.
- Let's go formative: Continuous student ratings with Web 2.0 application Twitter; 2009; Burger, C., Stieger, S.
- Using Web 2.0 application Twitter for formative course evaluation: a case study; 2009; Burger, C., Stieger, S.
- Forced response in online surveys: bias from reactance and an increase in sex-specific dropout; 2007; Stieger, S., Reips, U. -D., Voracek, M.
- Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research; 2004; Reips, U.-D., Stieger, S.